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(57) Abstract 

The invention relates to a method for producing computer 
processed animation. A work station (4) which comprises a com- 
puter and peripheral equipment is operative in producing a gra- 
phic movement sequence for a cartoon figure (10), by compiling 
a recording of measuring data from strategic parts of an actor, 
and storing in a memory (7) information concerning the figure to 
be animated. The figure is divided into a plurality of sections 
which are movable in relation to one another. Prior to figure 
compilation for producing an image of the figure, the measuring 
data recording for each section is obtained in the form of a space 
angle. Prior to compiling each section, a grouping of a pre-deter- 
mined number of perspective drawings is stored, in digitaiized 
form in a respective area of the memory (7), each grouping in a 
plurality of mutually different space angle positions. A memory 
area of interest representing a perspective drawing of one of the 
sections can be addressed with the aid of information relating to 
said space angle obtained from the measuring data recording for 
the section concerned. The figure is compiled in the compilation 
image in accordance with a pre-determined sequential compila- 
tion schedule, section after section, wherein each subsequent sec- 
tion is added to nearest proceeding section at a joint location 
(e.g. M2, M3, etc.) common to both sections. 
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METHOD AND DEVICE FOR COMPUTERIZED ANIMATION 
TECHNICAL FIET.n 

The present invention relates to a method and apparatus 
for producing animated film, in which the movements of 
live actors and actresses are recorded in combination 
with data stored information relating to the figures or 
characters to be animated. 

BACKGROUND PRIOR AT^T 

The traditional production of animated film is encum- 
bered with the time consuming and difficult task of 
creating figures which move with credible fluidity and 
"humanism" • Many cartoon films are produced by the so- 
called rotoscope technique, in which subsequent live 
actors and actresses are filmed and a drawing is made of 
each film frame- Cartoon films which have been produced 
by this technique include "Snow White and the seven 
dwarfs", "Cinderella", "Pongo and the 101 dalmations", 
"Jungle Book", etc. Although this method produces excel- 
lent results, it is both time consuming and expensive. 
In recent years endeavours have been made to simulate 
human behaviour with the aid of data technology. This 
task has proven to be almost impossible in practice. It 
requires the computer to be programmed with information 
defining the entire body-behavioural patterns of the 
person concerned. It would require a computer capacity 
of astronomical proportions to manage a control system 
of this magnitude. 

Partial solutions have been devised, e.g. animating 
systems which recreate lip movements subsequent to 
recording speech sound in the computer. If the actor/ac- 



tress is silent, however, the computer-generated mouth 
remains closed. Lip animation is rigid and restricted 
solely to actual speech . 

,^510,210 describes a technique for producing 
animated film wherein the movements performed by an 
actor are fed into a computer, by recording a multiple 
of optically discernible reference points on the actor 
in relation to a background reference; wherein the 
recorded reference points are compared at regular inter- 
vals with pre-stored batches of figures drawn in 
mutually different postures and positions, so as to 
select the batch which closest resembles the posture^ 
attitude, etc. of the actor at the time chosen, and 
wherein there is generated from the computer a series of 
pictures or images of the cartoon figure with a body 
position or posture corresponding to that of the actor 
concerned, at the selected recording times. The pictures 
produced are preferably copied as Xerox transparencies, 
which are modified manually and supplemented with suit- 
able background material, etc., in a conventional 
manner, to form cells which are then photographed* 

The animating technique described in the aforesaid OS-A- 
3,510,210 has a number of deficiencies which render it 
unsuitable for the production of high-quality animated 
film. One decisive deficiency with regard to the area of 
application envisaged is that the technique only permits 
2-dimensional "upfront" -recording of the actor's move- 
ments and is therewith limited solely to lateral and 
vertical movements of the cartoon figure, and also that 
there are no permissible degrees of freedom which enable 
the figure to be covered from different "camera" angles. 
Furthermore, no information is given as to the possibil- 
ity of computer- integrated processing of recordings of 
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the actor's movements, interaction of the figure with 
objects and other figures, selection of body compilation 
of the animated figure, integration with background, 
creation of shadows and reflexes, etc. In those in- 
5 stances when these functions are mentioned, it is ob- 

vious that they are intended to be inserted manually in 
a conventional manner, with the aid of the cells formed 
by producing Xerox transparencies. 

10 OBJECT OF THE INVENTION 

The object of the present invention is to overcome and 
reduce the limitations of known computer-supported 
character animation systems with respect to the number 

15 of possible degrees of freedom, and to provide for 3- 

dimensional representation in both the capture of orga- 
nic movement data and in graphic figure representation, 
and also to produce so-called character animation by 
storing artist-made key drawings in sequential represen- 

20 tation covering the full sphere of observation of each 

jointed body segment or part so as to enable movement 
data captured from a human actor to be taken from a 
corresponding movement sequence of the animated or 
cartoon figure - 

25 

The invention does not include the method by means of 
which movement data is captured per se , or the manner in 
which the actor and the prestored figure are divided 
into smallest articulated part volumes. The invention 
3 0 distinguishes from known data animation systems in which 

figures and objects are constructed as 3D-defined 

"solid" objects and in which animated movements are 
programmed from a keyboard, mouse or some other form of 
communication unit. 



35 
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A pirianary object of the invention is to provide a data- 
supported animation system which will enable the actions 
of an actor to be directed and, at the same time or at 
short time intervals, will also enable graphic figures 
5 or characters which reproduce or relive the actions of 

the actor to be created and presented on a television 
monitor for instance. 

Another object of the invention is to provide an anima- 
10 tion system which will afford a wide scope with wide 

freedom of expression on the part of the animator on the 
basis o£ the fundamental movement pattern of the actor 
concerned. 

15 These and other objects of the invention will be more 

apparent from the following description. 

SUMMARY OP THE INVENTION 

20 The aforesaid objects of the invention are achieved by 

means of the inventive method of animation and the 
animation apparatus defined in the following claims and 
described in more detail herebelow. 

25 The invention is based on the understanding that each 

individual person can be considered as a single entity 
which comprises a multiple of segments joined at fixed 
or jointed locations, where each segment has an inner 
attachment point in the centre of a sphere and an outer 

30 attachment point at some location on the surface of the 

sphere. In turn, the inner attachment point is the outer 
attachment point for another graphic segment and the 
outer attachment point is the inner attachment point for 
the next segment, and so on. Correspondingly, a figure 

35 which is to be animated can be divided up into corres- 



ponding segments, defined in accordance with joint 
limits, where each joint is allotted a unique control 
code . 

According to the invention, the performance of the human 
actor is directed on the basis of this division of 
measuring points corresponding to the aforesaid joints, 
the three-dimensional positional coordinates of these 
measuring points being registered and later used to 
control the development or presentation of the cartoon 
figure. The invention is thus based on the concept of 
taking positional and movement data from a live actor in 
real time and generating from said data a corresponding 
animated sequence of a computer-stored cartoon figure. 
However, this is only the basic concept of inventive 
animation system and the system will, in addition, also 
contain comprehensive process functions, as described in 
more detail herebelow. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

As before mentioned, the present invention relates to a 
novel method of producing animated cartoon film with a 
starting point from a human actor whose movement pat- 
terns are registered in digital form for the purpose of 
generating corresponding movements of a cartoon or 
graphic figure stored in the memory of a computer. 

The movements executed by the actor are identified and 
recorded, preferably in respect of six separate sectors 
and segments included in said movement group, i.e. head, 
torso, left arm, right arm, left leg, right leg. The 
cartoon figure has been stored in the form of a multiple 
of key drawings for each body segment, each of which has 
been allotted a part code for a contemplated, continuous 
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pattern of movement. For instance, when the actor's left 
arm is located in a certain position, this arm position 
is recorded and identified as being representative of 
the positional values of the joints involved. These 
5 values call corresponding, computer-stored arm segments, 

or are used to construct in the computer corresponding 
arm segments from closely resembling key drawings. In 
the figure compilation shown on a monitor screen for in- 
stance, the arm drawing is placed together with the 
10 other parts of the body at their respective joint posi- 

tions and the unprocessed result becomes the cartoon 
figure which. moves in the manner of the actor. 

STORAGE OF FIGURE DATA 

15 

The chosen cartoon figure is divided up preferably into 
corresponding sectors, head^ torso, arms, legs and the 
segments included therein. An artist produces for each 
segment as many key drawings as are required to describe 

20 all movements to be performed by the body segment con- 

cerned. Successive key drawings will preferably be so 
similar to one another as to enable the computer to 
compile intermediate positions from two mutually 
adjacent drawings. When entering the data into the 

25 computer memory, those regions which are later to be 

coloured are preferably provided with a code which will 
enable the pigmentation (colour) of the figure to be 
changed, and modulated in accordance with background or 
surroundings - 

30 

RECORDING OF ACTOR PERFORMANCE 



35 



An actor performs in front of an optical or electromag- 
netic recording system which records the actor's move- 
ments continuously from at least three measuring angles 
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and transmits the movement data to be registered in a 
computer in the form of movement vectors for a plurality 
of joint locations and their mutual angular relation- 
ships. In this digitalized form, the movement positions 
5 of each segment become a code which can be used to 

summons the graphic equivalent stored in the computer 
memory • 

COMPILATION AND OUTPUT 

When storing the segments of the cartoon figure, the 
joint location of each segment is given as a respective 
link to the next body joint. The figure is compiled, or 
put together, with the aid of this data, together with 
information concerning the mutual forwardly lying/rear- 
wardly lying relationships of the segments, and the 
figure is generated in film/video format. 

PROCESSING FUNCTIONS 
20 

The actor shall be considered solely as a data producer 
and the constitution of the actor's body has no sig- 
nificance whatsoever with respect to the appearance of 
the figure, since the system does not measure propor- 

25 tions, but solely the mutual angular relationships of 

different body members and joints- In other words, 
positioning of the measuring points is local and related 
to the nearest inner joint. The result obtained when 
purely scanning the actor shall be considered as basic 

30 material for the processing, revising and modulating 

facilities included in the system. 



10 



15 



35 



The speed of figure movement can be influenced, or 
determined, by the actor scanning density. The standard 
film/video speed is 25/29 frames per second. The speed 



8 

of figure movement: can therefore be increased or decrea- 
sed, by recording actor movement at a higher or lower 
frame speeds 

The whole or parts of the movement dynamics can be 
controlled by recording body movements at a given multi- 
ple. For instance, all horizontal movements can be 
recorded at a multiple of 1*2, or all arm movements at a 
multiple of 1.4, etc. 

Furthermore, a constant value may be added to the posi- 
tional code of a segment and therewith influence its 
constant "working position" in relation to the horizon- 
tal or vertical plane^ e.g. so as to obtain an inclined 
position. 

The movement dynamics can also be influenced by the 
introduction of so-called conditional features. For 
instance if the actor moves his head faster than a 
given speed, the sequence of movements prior thereto are 
recorded in real time, whereas subsequent movement is 
either recorded with a multiple or is delayed for a 
given length of time and then released in a compressed 
and shortened form. 

Such conditional features can also be used to "envelope- 
format" the movement dynamics, i.e. define a limit value 
which ^ when exceeded, affords adjustable manipulation in 
time compression and multiple amplification. It is 
possible to manipulate individual sectors,- movements in 
the X-,Y- or Z-directions , or the whole. 

By defining a given movement, the movement can be repla- 
ced by a preprogrammed movement, with the aid of said 
conditional features. 
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Several mutually different and simultaneously active 
cartoon figures can be controlled with th-e aid of data 
obtained by recording actor-movement three-dimensional- 
5 ly. These figures can perform from mutually different 

perspectives, may be mutually displaced in time and may 
have mutually different appearances, but the data res- 
ponsible for the individual movement patterns may come 
from one and the same source of movement. 

10 

Such parameters as hair or hats can be stored separately 
in different movement dynamics and later summoned with 
the aid of conditional features and incorporated in the 
figure. (For instance, if the figure moves faster than 
15 iii/sec, incorporated hair-sequence iii). 

A scene which entails interplay between figure and 
objects can be performed with a "dummy" included in the 
system and provided with position and movement iden- 
20 tification marks. Subjects which are not easy to record, 

e.g. liquids, can be positioned marked with a dummy 
(e.g. a ball emptied from a bucket), which when com- 
piling the figure marks position, direction and speed of 
the stored animated water sequence to which it relates. 

25 

Interplay between two actors can be recorded separately 
with each actor. The position of the actor's partner can 
be marked with a defined dummy so as to enable the 
mutual positions of the actors to be coordinated when 
30 compiling the figure. 

These manipulations can be made "on-line" when recording 
the actors, although it is important in practice to be 
able to advance by trial and error and the possibility 
35 to experiment is very significant, and consequently it 
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can be beneficial to store the unprocessed performance 
of the actor, both visually in video form and in coordi- 
nate form in a computer memory, so as to be able to 
modulate and process said performance at a later oppor- 
5 tunity . 

SPEECH AND FACTAT. EXPRESSTQKS 

Speech and facial expressions can be advantageously 
10 recorded separately (as in the case of traditional dubb- 

ing) . The appropriate data can be inserted in the out- 
put, so as to control the speech and facial expressions 
of the graphic figure at the angle earlier determined by 
the position of the actor. 

15 

The mouth movements of the cartoon or graphic figure can 
be generated either from an analysis of the vocal and 
consonant sounds uttered by the actor, for instance in 
the manner proposed in US-PS 4,260,229, or preferably by 

20 optically marking the actor's mouth and analysing and 

identifying the shape of the mouth against an elliptical 
model whose axes can be varied. The model is used to 
define various different shapes compatible with various 
expressions or attitudes of the human mouth. Each of 

25 these mouth expressions is given a sequential identifi- 

cation code so that compilation can be effected from the 
stored graphics corresponding to the identified shape, 
or expression. 

30 In the case of complicated mouth configurations, such as 

duck bills, etc., for instance, the feature can be 
compiled from a computer generated 3D-model produced as 
a linear graphic in accordance with the artist's con- 
figuration and the mouth shapes controlled from the 

35 actor's lip movements. 
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The mouth can be marked either at optically detectable 
points for analysis in a CCD-camera system, e.g. 
SELSPOT, or with discernible colour markings in the form 
5 of dash-marked lips which are later analysed according 

to shape changes with e.g. so-called SNAKE software 
( Schlumberger Palo Alto Research). Similar to the repro- 
duction of body movement, the dynamics of mouth movement 
can also be manipulated. 

10 

Data relating to the shapes and forms of the eyes and 
eyebrows is also captured in a similar manner, with 
geometric reference to an elliptic form, and compilation 
is effected from a stored graphic representation. With 
15 regard to the analysis and transmission of iris posi- 

tional, data, capturing solutions are known by means of 
which a circular shape can be identified and positioned 
within an ellipse. 

20 EDITING OF FIGURE AND IMAGE 

In order to enable a long movement sequence to be shor- 
tened or spliced without increasing the speed of the 
movements, the system is able to search for the most 
25 similar movement positions on both sides of the splice, 

sector for sector. In the case of the preferred embodi- 
ment, this involves splicing the sectors at six mutually 
different occasions when respective positions lie opti- 
mally close to the spliced sequence. 

30 

The system can also combine traditional animation tech- 
nology, in which long sequences are drawn and entered 
into the computer memory and the figure composition 
defined with regard to speed, proportions and position 
35 in the image ( "dummy"-related or stationary). Before 
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arriving at the final result, the producer has the same 
possibilities image-wise as in traditional film/video 
production/ cutting or viewing, split screen, tilting, 
laasking^ full image, half image and close-ups, etc. 

Colouring of the figure is related to the areas defined 
when storing. These areas can then be modulated in 
desired hues , shades , nuances , etc . , or conditionally 
based on surrounding colour backgrounds. 

The system also includes the figure in an environmental 
or background iiiustration and, furthermore, a figure 
shadow can be generated on the basis of a contemplated 
light angle, from the 3-dimensional position of the 
actor. The figure shadow is generated from the same data 
store, but with transparent photocomposition and graphi- 
cally compressed horizontally. 

The background illustration is stored as a sequence, 
when it contains moving elements. It can also be stored 
at different depth levels, so as to allow the figure to 
perf oirm in front or behind the elements in the environ- 
ment. 

It is also possible to store photographs instead of 
drawings accordinof to the same system, with key posi- 
tions and sectors. In this case, the actor's movements 
can then be caused to control human figures, puppet-like 
figures, objects, animals, etc- 

The inventive animation system will quickly give a 
viewable result and optimum naturalness in the movement 
patterns of the figures, and also affords positive 
editing and processing possibilities and a wide degree 
of freedom in experimentation and modulation in com- 



parison with traditional film. 
ALTERNATIVE IN-FEED 

To provide for maximum flexibility and artistic utility, 
the inventive system can be provided with alternative 
parts for other kinds of input data than actor record- 
ings, e.g. light pens, "mouse", digitaliser, etc. 

In the case of post edition with, e.g. , mouse, the 
editing process is effected for two grids for the X and 
Y planes respectively. 

The compilation of the cartoon figure is addressed 
sectionwise to each of three defined depth planes: 
Centre, Front or Back. This can be effected automati- 
cally in accordance with conditional features relating 
to the mutual positions of the sectors during the re- 
cording process. 

The invention will now be described in more detail with 
reference to the accompanying drawings, in which 

Figure 1 is a block schematic of one embodiment of an 
arrangement for carrying out the invention; 

Figure 2 illustrates an example of one sequence of 
stored drawings (graphics) for one section of an image; 

Figure 3 illustrates an example of stored variants of 
one of the drawings in Figure 2; 

Figure 4 illustrates an example of stored variants of 
standard geometric shapes, for comparison and calling up 
suitable mouth shapes for a cartoon figure; 
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Figure 5 illustrates differences between the eyes of an 
actor and graphic variations thereof; 

5 Figure 6 shows graphically a matchstick figure with 

oLral^s , used to illustrate the invention in respect of 
one example; 

Figure 7 illustrates - a figure whose proportions are 
10 quite different to those of the actor; and 

Figure 8 illustrates how a figure can be changed from 
one graphic image to another, and also illustrates 
movement of the figure, 

15 

Figure 1 illustrates schematically an actor 1 in respect 
of whom a plurality of measuring points Ml, M2 , M3 ^ etc, 
are recorded. A recording device or system 2 records the 
positions of these points in space. The recording sys- 

20 terns itself forms no part of the present invention. 

There are several different types of systems on the 
market intended for recording three-dimensional (3D) 
information relating to the movements of an actor during 
an event sequence and for storing this infoinnation in 

25 digital form in a computer memory which can be used as 

the recording system 2 in conjunction with a special 
actor's costume, e.g. DATASUIT, or other recording 
systems in which measuring points are applied separately 
to the actor, e.g. SELSPOT. Both of these systems are 

30 particularly adapted for image sequence recording and 

are able to provide a list of 3D-coordinates for each of 
the actor '^s joints and for each movement registered in a 
recorded 

sequence. It is a particularly essential feature of the 
35 invention that each jointed section of the actor can be 
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registered in respect of its angular position in space. 
The aforementioned system DATASUIT functions with fibre 
optics in combination with electric SD-sensors and 
produces absolute cartesian space coordinates. The 
aforementioned system SELSPOT works with scanning 
cameras . 

The recording system 2 can comprise a combination of 
several different kinds of recording system, of which 
the recording system best suited for the recording 
concerned is either used on its own or together with 
some other kind of recording system. There can be used a 
known system intended particularly for indicating com- 
plicated movements, e.g. finger movements, such as the 
DATAGLOVE system for instance. Different systems are 
also to be found for recording segments in facial 
expressions, such as eye and mouth movements, which can 
be utilized so as to enable the result of such record- 
ings to be combined with the invention. 

Recording in the recording system 2 is effected on-line, 
e.g. with normal film and video picture display stan- 
dards with 25 or 29 movement recordings per second or at 
twice this frequency, during the sequence in which the 
actor performs. Each movement recording will then in- 
clude a recording of all measuring points. The recording 
system 2 feeds the actor-generated movement information 
to a unit 3 which either passes this information 
straight to a work station 4 or to a recording medium 
unit 5 suitable for the purpose. The work station may 
have the form of a PC-compatible computer for instance, 
or may also be a graphic computer, e.g. a Hitachi GDP. 

The record medium in the unit 5 may be any type of fixed 
memory which is capable of storing large quantities of 
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data, sucti as a floppy disk, magnetic tape, CD-disk or 
the like. This laanner of storage enables suitable actor 
perfozTnance seguencies to be recorded at appropriate 
times and then summoned from a filing system when re- 
quired. In this case, the unit 3 may function as a read- 
unit which is controlled from the work station 4 to read 
information from the recording medium in the unit 5 and 
to transfer this information to the -work station, where 
the information is stored in a specific area of a tem- 
porary working memory 6 allotted for this purpose. Con- 
nected to the work station 4 is an external memory 7 
which includes a data base containing segments of the 
cartoon figure or figures to be animated. 

Figure 2 illustrates a sequence of drawings of the head 
of a figure stored in digital ized form and with the head 
shown at different space angles • A significant feature 
of the invention in this regard is that the stored 
segment drawings are representative of different posi- 
tions within the sphere of a per f omnance , i.e. the 
segments are not stored solely as two-dimensional ele- 
ments, but that each segment is represented in the 
various perspective configurations which it is capable 
of assuming and are drawn by an artist on a graphic 
template which describes the potential three-dimensional 
radius of movement of the segment. Information relating 
to other body segments , such as upper arm, lower arm, 
hands, etc., is stored according to the same system. 
Head images are the most illustrative in this context. 
The images of an upper arm, for instance, substantially 
have the appearance of a tube of different lengths drawn 
in perspective from the starting point of a central 
position representative of one of the arm joints, depen- 
ding on prevailing angular positions in space. Natu- 
rally, the images of each segment are stored in accor- 



dance with a logic system which enables the computer to 
address readily the correct image in a stored sequence 
for each frame to be recorded, when the space angle of 
corresponding actor segments in corresponding images of 
the actor is known. An example of such a logic system is 
described below with reference to Figure 6. 

The faces in the sequence shown in Figure 2 all have the 
same expression. In order to appear to be alive, the 
cartoon figure must be given different facial expres- 
sions. The eyes, eyebrows, mouth and optionally also the 
cheeks of the subject (the actor) are also marked, 
similar to the aforegoing, key records are stored of the 
movement spectrum of the cartoon figure. The facial 
expression of the actor, e.g. eye movement, eyebrow 
movement and mouth movement can be recorded separately 
in the recording arrangement 2 at one and the same time 
and are also stored in the memory 6 on the occasion of 
compiling the cartoon figure. 

Figure 3 shows the face A of Figure 2 in larger scale 
and illustrates a sequence in which the face has dif- 
ferent expressions, not within one and the same sphere 
of performance. Alternatively, mouths can be taken from 
a separately stored mouth shape index, e.g. the index 
illustrated schematically in Figure 4. The length of the 
mouth and the extent to which the mouth is open or 
closed, referred to hereinafter as mouth height, can be 
adapted to the prevailing angular position of the head 
in space with the aid of a specific algorithm. This 
algorithm is either stored in the external memory 7 
connected to the mouth index, and then adapted quite 
specifically to the figure concerned, or is incorporated 
in the software installed in the work station, in which 
case it will be similar for all types of mouth 
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indexes. When possible, a corresponding procedure can be 
adapted to produce a full face expression^ as illu- 
strated in Pigure 3^ which enables specific fixed points 
to be marked in relation to the head shown in Figure 2- 

In the case of the mouth, it is practical to start from 
a convex ellipse having two axes X and Y, for the pur- 
pose of determining mouth length and height dimensions. 
Because it is possible to displace the point at which 
these axes intersect , therewith altering the position of 
the centre of the ellipse, a great many facial expres- 
sions can be created. To this shall be added the pos- 
sibility of "twisting" the convex ellipse about an 
imaginary or contemplated horizontal axis, which raises 
or lowers the corners of the mouth. It should be noted 
that this geometric model can only be used to identify 
one phase of a continuous movement for the purpose of 
summoning its programmed counterpart. Consequently,, the 
ellipse per se shall not be transferred. 

The actor's, or subject's, mouth is preferably marked 
with two clear C straight) lines, alternatively with 
optically readable points. When this variant has been 
included in the preprogramming of the figure, the sub- 
ject's teeth can also be included in the lip expression. 
As in the case of body reproduction, the mouth dynamics 
can also be reproduced to a greater or lesser extent, 
this extent being dependent on the multiple used in 
tr ansmi s s ion . 

Particularly in the case of facial expressions, the work 
entailed in drawing, for instance, the mouth to cover 
all conceivable expressions and all 3D-positions for 
each individual expression would be extremely excessive. 
In such cases, it may be more expedient to draw only one 
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picture for each expression concerned and then to c- 
ompose for said each expression a mathematical 3D model 
which is processed with the aid of a suitable algorithm 
in the work station, such as to provide the 3D-position 
5 concerned. In this case, each expression model has a 

number of given points and/or lines (dashes) which shall 
be transposed onto corresponding points and/or dashes on 
that part of the face where the mouth having the in- 
tended expression or mimetic concerned. The size of the 
10 computed mimetic position is adjusted, so as to enable 

said adaptation to be effected. 

Eye movements are recorded in a similar manner. Suitable 
identification models will also in this case have the 
15 form of a convex ellipse. Positioning of the human pupil 

of the master model, or actor, controls the predrawn 
position in accordance with a known method. Since the 
method used in this regard is known, it will not be 
described here. 

20 

The eyes in the top row of Figure 5 depict camera recor- 
dings made by a camera focussed on the actor's eyes, 
whereas the eyes in the bottom row each correspond to a 
graphic variant. The centres of the eyebrows are in 

25 relation to the centre of the "eye-ellipse". The geo- 

metric figure may be a compensatable arc having a pair 
of modulating variants. It is conceivable that in some 
positions, the shape of the eyes of the cartoon figure 
will not depend on the position of the eyebrow, as shown 

30 by way of example on the right of Figure 5. 

Returning to Figure 1, the work station thus functions 
such as to, for each frame to be recorded, compile the 
figure such that said figure, with a starting point from 
35 a starting point Ml, which is preferably the lower part 
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10 



of the figure's torso, one of the actor's stored seg- 
ments which departs from said starting point, is read 
from the memory S, e.g. the torso part. In the illu- 
strated embodiment of Figure 1, this part has four 
measuring points Ml, M2, M4, M5 which are in fixed 
relationship with one another. The memory 6 either has 
written thereinto calculations which relate to torsion 
attitudes, e.g. torso-bending and twisting, or the 
cartesian coordinates of the measuring points. The work 
station 4 is programmed to calculate the correct address 
for fetching a stored torso image from the memory 7 and 
storing this image temporarily in the memory 6j on the 
basis of the mutual relationship of the measuring points 
read from the memory 6. The right upper arm, located 
15 between M2 and M3, is included subsequent hereto. 

The work station searches the memory 6 for the section 
between the points M2 and M3 , which can be stored in the 
memory either in the form of the coordinates of said 

20 points, in which case the work station computes the 

prevailing angular position, or directly as an angular 
position which, for instance, has been pre-calculated in 
the unit 3 or as early as when being recorded in the 
unit 2 - Thus the time at which the calculations for an 

25 individual segment are carried out and in which unit of 

the system is a matter of relatively free choice and is 
decided by the circumstances prevailing in each separate 
case. One essential factor in this connection is that 
the work station 4 is able to obtain on the basis of the 

30 information stored in the memory 6 with respect to a 

segment for an image in question, an address with which 
there can be taken from the memory 7 an image of the 
segment entailed in the correct 3D-position concerned, 
either immediately or after processing the image in a 

35 predetermined fashion. For instance, if the upper arm. 
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predetermined fashion. For instance, if the upper arm, 
located between points M2 and M3 , is taken from the 

memory; the upper arm is positioned in the image such 
that the point M2 on the torso and the point M2 on the 
5 upper azTti (this point being located centrally in the 

movement sphere of the upper arm) will overlap one 
another. Each joining or connecting point is called a 
joint • 

The work station thus edits in the memory 6 , obtains 
from the data stored therein an address by means of 
which correct image parts can be found in the data base 
memory 7 and joins the thus obtained image parts in a 
selected sequence and then presents the compilation on 
one or more display units, such as a monitor 8, or on a 
projection area of a film. Figure 1 illustrates to one 
side of the monitor, an exemplifying cartoon figure 
which originates from the measuring points M1,M2, etc. 
on the actor 1 • The matchstick image 1 is shown in 
broken lines in the figure 10 for reasons of illu- 
stration, although it will not, of course, be included 
in the graphic figure in reality. 

The figure may, conveniently, first be drawn on the 
25 monitor 8 during the animating procedure. The operator 

can then make any necessary adjustments through an 
operator control system 11, such as a keyboard, a mouse, 
a digitalizer board, or the like- The completed graphic 
figure can then either be stored temporarily in the 
30 memory 6 or in a record medium of some suitable kind, 

such as a floppy disc or the like, located in a record 
medium unit 12, or may be drawn on film in a unit 9. For 
instance, long sequences of a performing graphic figure 
may be stored in the record medium or carrier in the 
35 unit 12 and fetched at a later point in time and then 
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assembled image by image with, one or more similarly 
stored figures and/or backgrounds, to produce an assem- 
bled presentation, although it will be understood that 
each sequence of the compilation or presentation may be 
stored in a second medium in the unit 12\ 

As shown in Figures 2 and 3, at least each of the seg- 
ments which are to be jointed or hinged together is 
stored in its various different angular positions in the 
form of circles in which segment variants are drawn and 
also the joint by means of which it shall be joined or 
hinged to the immediate preceding graphic segment ''s 
outer pole as a centre, in accordance with a predeter- 
mined schedule. It can be said that all the circle 
images of a segment form the movement sphere of the 
segm^ent. It is the circle image which is moved over and 
drawn in its entirety (naturally, without the circle 
line). The next joint, corresponding to a measuring 
point on the actor, is to be found at some location 
within the circle or on its circumference and is also 
found marked or labelled digitally in connection with 
the circle image in the memory 7, so that the work 
station is able to read-out said circle image and calcu- 
late the position in the image of the next joint, i.e. 
joining point, on the basis of the position in the image 
of the aforesaid joint and position of the next joint » 

Although it is practiable to store all segment images in 
the form of circle images , it will be understood that 
each joint can, instead, be stored solely as a drawing 
which departs from a central point. 

Figure 6 illustrates an assembled matchstick man in that 
instance when all joining points to immediately follow- 
ing segments lie on the circumference of the stored 
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circle, i.e. the matchstick man adopts a position such 
that all of the measuring points lie in a two-dimen- 
sional plane (so-called upfront recording), which is 
actually very unusual in practice, 

5 

EXAMPLE 



This example refers to Figure 6 and describes how a 
storage schedule for an actor with graphic or drawn 
10 segments can be carried out in reality. 

The recording of an actor is marked at 18 points: Hip 
bones 3 points, torso 4 points, head 3 points, left and 
rightr arms and left and right legs 2 points each. These 
15 18 points characterize 15 movement spheres (In this 

case, fingers can be constructed as a subject with 
contours. 20 measuring points are required, if fully 
integrated fingers are desired.) 

20 The figure is stored in segments: head = one segment; 

torso = one segment; hips = one segment; each arm = 
three segments; each leg = three segments. This results 
in nine event spheres , where arms and legs are generated 
in left and right positions from mutually the same data 

25 base material. In turn, this results in the storage of 9 

X 32 == 288 key drawings. 

The movement sphere of each body sector is defined as a 
spiral in three planes, where X describes a 360 degree 

30 horizontal radius, Y describes a corresponding vertical 

radius and Z describes a "depth" radius. The Y-position 
is shifted through one degree with each completed revo- 
lution in the X-direction. The Z-position is shifted 
through one degree with each completed revolution in the 

35 Y-direction. 
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If the movement resolution is determined to 240 posi- 
tions per revolution and axis (= 1.5 degrees) the theo- 
retical numerical spectrum will be 
5 for X: 0-239 in intervals of 1 

for Y: 0-57360 in intervals of 240 
for Zi 0-13824000 in intervals of 57600 

The values denote all of the positions in which an 
object can be viewed. However, the movement spectrum is 
repeated when Y and Z have reached half their respective 
radii ^ and hence the high numerical, values are more 
descriptive of the numerical identification than the 
data quantity. The drawings of the desired figure are 
scanned in as key drawings for the seven {7) body sec- 
tors. By "key drawings" is meant drawings in suffi- 
ciently dense position frequency for the computer to be 
able to construct those which are intermediate. Accord- 
ing to the aforedescribed algorithm, 32 key drawings per 
sector should be sufficient basis for visually present- 
ing the whole of the movement spectrum. 

The key drawings are then stored in the data base 7, 
together with a numerical value in intervals of 30 in 
25 the X-direction, 7200 in the Y-direction and 1728000 in 

the Z-direction. 

By handling the movement axes as powers in three stages^ 
it is possible to define a continuous course of movement 
30 while giving only one value at a time, which is a pre- 

requisite for being able to match the movement data of 
the actor with the movement data of the stored figure • 

The recording system requires a sampling speed of maxi- 
35 mum 9 kHz, in order to read a maximum of 50 points times 
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3 (X, Y, Z) 60 times per sec. Added to this is the need 
for a buffer which is capable of holding the 180 000 
parameters generated in one minute (= a/Mbyte), This 
buffer is preferably a hard disc. The actor's parameters 
5 are stored digitally, e.g. on a video tape. 

The system views a human figure as a multiple of linking 
spheres. Each joint describes a movement sphere in 
relation to the next inner joint or pivot point. For the 

10 purpose of defining each joint position isolated in 

relation to its "centre", the coordinate value of the 
inner joint is substracted from the coordinate, value of 
the outer point at the sampling moment. This results in 
"zero setting" of the centres. An overlapping sphere is 

15 described from a centre point in the hip bone of the 

actor. The angle of incidence of the contemplated camera 
on the figure to be drawn is determined by adding or 
subtracting the coordinate values of all of the joints 
or pivot locations. The angle of incidence of a con- 

20 templated light source is determined in a similar man- 

ner. The figure's projected shadow is created from 
another figure on the basis of the light coordinates. 
The figure is generated as a single-dimension projection 
which is "folded" in the longitudinal direction of the 

25 light in the point of contact of the original figure 

with the supporting surface. This flat "figure" is then 
coloured transparent and homogenous • 

For the purpose of structurizing insertion of key draw- 
30 ings into the data base 7, the user is provided with a 

number of "grids" or templates. These are three-dimen- 
sional graphic foundations which ensure that proportions 
and positions will agree and that linking to the next 
body part is defined in the digitalizing process. This 
3 5 can also be constructed as an integrated program routine 
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stored in tlie data base and fetched by the work station 
4, wherein the animator gives the figure measurements 
for different body sectors and thereafter either brings 
up respective "grids" on the screen of the monitor 8 as 
5 a foundation for "drawing" the body parts directly with 

the aid of the control unit 11, which may have the form 
of a so-called digitizer-board, or on paper from a 
connected printed for traditional drawing processes • The 
"grid" may have the form of a squared globe, where 
10 positioning of the body sector is based on the centre of 

the globe, said centre defining the link-up with a 
previously drawn body part* Each "grid" has a marking- 
for the extrapolated position and its predefined nume- 
rical code. 

15 

Initial drawings for each sector in initial Y- and 

Z-positions together give three-dimensional, i.e. per- 
spective, contour information, so that, for instance, 
light shadows, etc., can be included at a later stage. 

20 

As illustrated in Figure 7 , it is not necessairy for the 
respective segments of the graphic figure to have the 
same proportions as those of the actor used as the 
master model. Since it is only the angular position in 

25 space of each segment of the' model, or actor, that is 

utilized for drawing of the figure, and not the mutual 
relationships between the cartesian coordinates of the 
measuring points or the mutual relationships between the 
lengths of the segments ^ a freely chosen cartoon figure 

30 can be animated readily and with good results by means 

of the method according to the invention. The central 
line proportions of the figure, compared with the model, 
are adapted in the work station 4 to the specific body 
constitution of the figure. 
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Figure 8 illustrates an example of a cartoon figure 
compiled from stored segments. The example shows the 
figure with mutually different arm positions, but with 
the remainder of the figure stationary • The various arm 
5 joints are marked as circles in the figure, such as for 

instance point m2 , which is static for both arms- 
positions of the right arm, and point m3' for the arm in 
one position, and point m3" for the arm in another 
position. 

10 

Many modifications can be made within the scope of the 
invention. For instance, the block schematic of Figure 1 
can be changed in various ways, as will be understood by 
the person skilled in this art. For instance, the ele- 

15 ment 3 can be incorporated in the work station. Alterna- 

tively, the elements 2, 3 and 5 for recording purposes 
may be a separate unit used solely for registering actor 
movements when recording movement sequences. In this 
case, the work station and peripheral equipment may be 

20 placed in a location which is physically different to 

that of the recording unit. In this case, the record 
medium containing actor information can be optionally 
read into the work station from the record medium unit 
12. Also, the memory 6 may optionally have the form of a 

25 data base into which long actor performance sequencies 

can be written. 

Naturally, the inventive method can be used to animate 
moving objects other than those based on human figures 
30 or animals. Examples of such moving objects include 

different types of machines, water falls, medicinal 
systems, such as blood circulating systems, plants in 
high winds, etc. 
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CLAIMS 

1- A method for producing computer processed animation, 
in which a work station comprising a computer and perip- 
heral equipment produces a graphic movement 
sequence for a graphic figure, by compiling a recording 
of measurement data from strategic parts of a real 
moveable unit, e.g. an actor, and infoinnation stored in 
a memory (7) concerning the figure to be animated, the 
figure being divided into a plurality of sections which 
are movable in relation to one another, characterized in 
that before compilation of the figure, in order to 
provide an image of said figure, measuring data 
recordings in the form of space angles are obtained for 
each section; in that prior to said compilation a group 
of a pre-determined number of perspective drawings for 
each said section and each group in a multiple of mutu- 
ally different space angle positions, are stored in 
digitalized form in a respective memory area in the 
memory (7), in which memory the memory areas repre- 
senting a perspective drawing of one of the sections can 
be addressed with the aid of information relating to 
said space angle from the measuring data recording of 
the section concerned; and in that the figure is com- 
piled in the compiling image in accordance with a pre- 
determined sequential compilation schedule, section by 
section, wherein each subsequent section is compiled 
with the nearest preceding section at a joint location 
common to both of said sections* 

2* A method according to Claim 1, characterized in that 
the perspective drawings for each section are provided 
with mutually different space angle positions in the 
form of drawings within a graphic movement potential- 
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3, A method according to Claim 1 or 2, characterized in 
that all perspective drawings for each section are drawn 
with a starting point from a central point representing 
the joint location of the compilation to the nearest 
preceding section in the compilation schedule; and in 
that each joint location of the compilation to a subse- 
quent section in the compilation schedule, which section 
shall be placed together with the section concerned when 
such a joint location is found for said section con- 
cerned, is marked in the stored digitalized representa- 
tion of the perspective drawing, 

4 . A method according to any one of the preceding 
claims, characterized in that one or more variants of 
the drawing of a suitable section is, or are, stored in 
the memory; and in that the perspective drawing of the 
section concerned is created with the aid of an algo- 
rithm which is either stored in the memory (7) together 
with the stored section drawing or the stored section 
drawings, or is incorporated in the computer software. 

5 • A method according to any one of Claims 2-4 , charac- 
terized in that the addressing of a given perspective 
drawing for a particular section on the basis of the 
information relating to the space angle concerned ob- 
tained from the measuring data recording is effected so 
that the graphic movement potential of each section is 
defined as a spiral in three planes, of which the first 
plane describes a first radius in one of a pre- 
determined number of degree shifts in a completed revol- 
ution, the other plane describes a second radius, per- 
pendicular to the first radius, in said pre-determined 
number of degree shifts, and the third plane describes a 
third radius, perpendicular to both the first and the 
second radius, in the pre-determined number of degree 



shifts; and in that the space angle obtained from the 
measuring data recording gives a specific position in 
the three planes and the storage of the different per- 
spective drawings is such that said addressing is effec- 
ted so that with each completed revolution in the first 
plane, the position in the second plane is advanced one 
step^ and that for each completed revolution in the 
second plane the position in the third plane is advanced 
one step, and that this procedxare is repeated cyclicly. 

6, An arrangement for producing data processed anima- 
tion, in. which, a work station. (4) including a. computer^ 
with peripheral equipment produces a graphic movement 
sequence for a graphic figure, by compiling a recording 
of measuring data from strategic parts of a real,^ mov- 
able unit, e.g. an actor (1), and further including a 
memory (7) in which information relating to the figure 
to be animated is stored, the figure being divided into 
a plurality of sections which are movable relative to 
one another, characterized in that the work station (4) 
before compilation of the figure to produce an image of 
said figure obtains measuring data recording for each 
section in the form of a space angle; in that stored in 
a memory area (7) for each section is a grouping of a 
pre-determined number of perspective drawings^ and each 
grouping in a plurality of mutually different space 
angle positions,^ these drawings being stored in digital 
f ona in . each memory area , and in which memory the memory 
area thereof which represents a perspective drawing of 
one of the sections can be addressed with the aid of 
information which relates to said space angle and which 
is obtained from the measuring data recording for the 
section concerned; and in that the work station is 
operative in compiling the figure in the compilation 
image in accordance with a pre-determined, sequential 
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compilation schedule, section by section, each sub- 
sequent section being added to the nearest preceding 
section at a joint location which is common to both said 
sections. 

5 

?• An arrangement according to Claim 6, characterized in 
that the perspective drawings for each section are 
stored in the memory area (7) in the form of drawings 
produced within a graphic movement potential and presen-- 
10 ting mutually different space angle position. 

8. An arrangement according to Claim 6 or 7 , charac- 
terized in that all of the perspective drawings stored 
in the memory area (7) for each section are drawn from a 

15 central point which represents the joint location of the 

compilation to the nearest preceding section in the 
compilation schedule; in that each joint location for 
the compilation to a subsequent section in the compila- 
tion schedule, which section shall be added to the sec- 

20 tion concerned when such a joint location is found for 

said section, is marked in the stored, digitalized 
representation of the perspective drawing. 

9. An arrangement according to any of Claims 7-8, cha- 
25 racterized in that one or more variants of drawings for 

a suitable section is, or are, stored in the memory area 
(7); and in that the perspective drawing of the section 
concerned is created by the work station (4) with the 
aid of an algorithm, which is either stored in the 
30 memory (7) together with the stored section drawing or 

the stored section drawings, or is incorporated in the 
software of the work station computer - 



10. An arrangement according to Claim 9, characterized 
35 in that the sections suited therefor are facial parts. 
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such, as mouth, and eyes; and in that several different 
facial expression representations of these sections are 
stored in the memory- 
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AMENDED CLAIMS 
[received by the International Bureau on 2 August 1989 (02.08,89) 
original claims 1 and 6 amended ; other claims unchanged ( 5 pages)] 



1. A method for producing computer processed animation, in 
which a work station comprising a computer and peripheral 
equipment produces a graphic movement sequence for a 
graphic figure, by compiling a recording of measurement 
data from strategic parts of a real movable unit, e.g. an 
actor, and information stored in a memory (7) concerning 
the figure to be animated, the figure being divided into a 
plurality of sections which are movable in relation to one 
another, characterized in that before compilation of the 
figure, in order to provide an image of said figure, 
measuring data recordings in the form of perspective 
drawings for each said section, every perspective drawing 
having an individual spece angle position among a multiple 
of mutually different space angle positions, are stored in 
digitalized form in a respective memory area in the memory 
(7), in which memory each memory area representing a per- 
spective drawing of one of the sections is addressable 
with the aid of information relating to said space angle 
from the measuring data recording of the section con- 
cerned; and in that the figure is compiled in the 
compiling image in accordance with a pre-determined 
sequential compilation schedule, section by section, 
wherein each subsequent section is compiled with the 
nearest preceding section at a joint location common to 
both of said sections. 

2. A method according to Claim 1, characterized in that 
the perspective drawings for each section are provided 
with mutually different space angle positions .in the form 
of drawings within a graphic movement potential. 
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3. A method according to Claim 1 or 2, characterized in 
that all perspective drawings for each section are drawn 
with a starting point from a central point representing 
the joint location of the compilation to the nearest 

5 preceding section in the compilation schedule; and in 

that each joint location of the compilation to a subse- 
quent section in the compilation schedule, which section 
shall be placed together with the section concerned when 
such a joint location is found for said section con- 
10 earned, is marked in the stored digitalized representa- 

tion of the perspective drawing. 

4 . A method according to any one of the preceding 
claiias, characterized in that one or more variants of 

15 the drawing of a suitable section is, or are, stored in 

the memory; and in that the perspective drawing of the 
section concerned is created with the aid of an algo- 
rithm which is either stored in the memory C^) together 
with the stored section drawing or the stored section 

20 drawings, or is incorporated in the computer software* 

5 . A method according to any one of Claims 2-4 , charac- 
terized in that the addressing of a given perspective 
drawing for a particular section on the basis of the 

25 information relating to the space angle concerned ob- 

tained from the measuring data recording is effected so 
that the graphic movement potential of each section is 
defined as a spiral in three planes, of which the first 
plane describes a first radius in one of a pre- 

30 determined number of degree shifts in a completed revol- 

ution, the other plane describes a second radius, per- 
pendicular to the first radius, in said pre-determined 
number of degree shifts, and the third plane describes a 
third radius, perpendicular to both the first and the 

3 5 second radius, in the pre-determined number of degree 
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shifts; and in that the space angle obtained from the 
measuring data recording gives a specific position in the 
three planes and the storage of the different perspective 
drawings is such that said addressing is effected so that 
with each completed revolution in the -first plane, the 
position in the second plane is advanced one step, and 
that for each completed revolution in the second plane the 
position in the third plane is advanced one step, and that 
this procedure is repeated cyclicly, 

6. An arrangement for producing data processed animation, 
in which a work station (4) including a computer with 
peripheral equipment produces a graphic movement sequence 
for a graphic figure, by compiling a recording of measur- 
ing data from strategic parts of a real, movable unit, 
e.g. an actor (1), and further including a memory (7) in 
which information relating to the figure to be animated is 
stored, the figure being divided into a plurality of sec- 
tions which are movable relative to one another, charac- 
terized in that the work station (4) before compilation of 
the figure to produce an image of said figure obtains mea- 
suring data recording for each section in the form of a 
space angle; in that stored in a memory area (7) for each 
section is a grouping of a predetermined number of per- 
spective drawings, every perspective drawing having an 
individual space angle position among a plurality of mutu- 
ally different space angle positions, these drawings being 
stored in digital form in each memory area, and in which 
memory each memory area thereof which represents a per- 
spective drawing of one of the sections is addressable 
with the aid of information which relates to said space 
angle and which is obtained from the measuring data re- 
cording for the section concerned; and in that the work 
station is operative in compiling the figure in the compi- 
lation image in accordance with a pre-determined , sequential 
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compilation schedule, section by section, each sub- 
sequent section being added to the nearest preceding 
section at. a joint location which is common to both said 
sections. 

7. An arrangement according to Claim 6, characterized in 
that the perspective drawings for each section are 
stored in the memory area (7) in the form of drawings 
produced within a graphic movement potential and presen- 
ting mutually different space angle position. 

8. An arrangement according, to Claim 6 or 7, charac- 
terized in that all of the perspective drawings stored 
in the memory area (7) for each section are drawn from a 
central point which represents the joint location of the 
compilation to the nearest preceding section in the 
compilation schedule; in that each joint location for 
the compilation to a subsequent section in the compila- 
tion schedule, which section shall be added to the sec- 
tion concerned when such a joint location is found for 
said section, is marked in the stored, digitalized 
representation of the perspective drawing. 

9. An arrangement according to any of Claims 7-8, cha- 
racterized in that one or more variants of drawings for 
a suitable section is, or are, stored in the memory area 
(7); and in that the perspective drawing of the section 
concerned is created by the work station (4) with the 
aid of an algorithm, which is either stored in the 
memory (7) together with the stored section drawing or 
the stored section drawings, or is incorporated in the 
software of the work station computer. 

10. An arrangement according to Claim 9, characterized 
in that the sections suited therefor are facial parts, 
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such as mouth and eyes; and in that several different 
facial expression representations of these sections are 
stored in the memory. 
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